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The  principal  effects  of  inflation  on  testing  of  new  weapon  systems 
are  to  compress  schedules  and  thereby  reduce  the  range  and  scope  of  system 
performance  which  can  be  assessed.  Test  planners  today  must  analyze  system 
performance  goals  and  system  design  and  then  predict  those  few  areas  where 
testing  is  most  likely  to  pay  off.  Testing  conducted  only  in  accordance 
with  these  predictions  can  fail  to  detect  significant  problems  which  will 
show  up  when  the  system  is  eventually  fielded.  A  new  approach  to  con¬ 
ducting  task  analysis  may  provide  better  indication  to  test  designers  of 
where  to  anticipate  problems  and,  hence,  where  to  apply  scarce  testing 
resources.  This  approach  was  developed  by  a  tri-service  committee  of  human 
factors  practitioners,  and  its  concepts  won  an  80Z  Indorsement  of  other 
practitioners  in  government  and  industry  who  responded  to  a  questionnaire. 


While  the  battles  of  consumers  against  Inflation  may  gain  the  most 
media  attention,  the  pernicious  effects  of  Inflation  are  felt  as  well  by 
weapon  system  testers.  Most  frequently  these  effects  are  felt  on  test 
schedules.  In  which  such  budget  contraints  as  "number  of  rounds  of  amm¬ 
unition  available"  dictate  shorter  and  smaller  tests.  Test  planners  are 
thus  faced  with  the  dilemma  of  whether  to  reduce  the  sample  size  on  which 
Important  generalizations  are  to  be  based  or  to  eliminate  whole  subtests. 
When  this  dilemma  Is  resolved  In  favor  of  the  statisticians,  one  of  the 
first  subtests  to  be  cancelled  Is  often  that  of  human  factors.  Historical 
grounds  for  this  decision  appear  to  Include  the  perceptions  that:  (1)  no 
Army  system  has  ever  been  cancelled  solely  for  human  factors  reasons,  (2) 
the  legendary  Ingenuity  of  the  American  soldier  will  enable  him  to  overcome 
or  at  least  compensate  for  disadvantageous  design  of  equipment,  and  (3)  If 
the  electrical  and  mechanical  subsystems  can  be  made  to  operate  with 
satisfactory  reliability,  the  whole  system  Is  probably  good  enough  to  go  to 
the  field. 

There  Is  growing  evidence  today  that  those  grounds  are  being  under¬ 
mined.  Human  factors  deficiencies  were  prominent  among  the  reasons  for 
Congressional  cancellation  of  the  Family  of  Military  Engineering  Construc¬ 
tion  Equipment  (FAMECE)  project,  and  the  prestlgous  Kerwln  and  Blanchard 
report  Man-Machine  Interface  -  A  Growing  Crisis  began,  "The  US  Army  has  a 
major  man-machine  Interface  problem...  The  problem  Is  severe  and  will 
continue  to  get  worse"  (p.  I).  Thus,  at  a  time  when  Inflation  Is  exposing 
testing  In  general  and  human  factors  testing  In  particular  to  severe  cuts 
or  elimination  altogether,  the  criticality  of  the  man-machine  Interface  Is 
Increasing.  Prudent  test  planners  are  today  therefore  casting  about  for 
more  efficient  means  of  determining  which  areas  of  system  testing  are 
likely  to  have  the  highest  payoff  In  terms  of  testing  resources  Invested. 


Human  factors  pr act  1 1 1 onar s  (particularly  within  the  Army)  have  pro¬ 
vided  ample  guidance: 

(1)  A  general  life  cycle  system  management  model  showing  the  Inte¬ 
gration  of  human  factors  and  Identifying  test  and  evaluation  activities  was 
published  In  1980  (Burt,  et.  al.,  1980). 

(2)  A  detailed  guide  for  gathering  and  analyzing  human  performance 
data  during  developmental  testing  was  Issued  by  the  USA  Human  Engineering 
Laboratory  In  1976  (Berson  and  Crooks,  1976). 

(3)  A  workbook  and  a  handbook  for  assessing  human  performance  during 
operational  testing  (known  as  HRTES)  were  developed  by  the  US  Army  Research 
Institute  (Kaplan,  et.  al.  1980). 

Although  each  of  those  documents  has  been  well  received  In  the  profes¬ 
sional  community,  there  remains  one  persistent  problem  whose  solution  has 
eluded  the  human  factors  and  training  community  for  years  and  Is  a  neces¬ 
sary  prerequisite  to  efficient  determination  of  high  payoff  areas  for 
Investment  of  testing  resources.  That  problem  Is  determining  and  then 
documenting  what  the  humans  In  the  system  have  to  do  (and,  therefore,  what 
training  they  have  to  receive)  to  make  It  work  properly.  The  means  most 
often  used  for  this  undertaking  Is  task  analysis. 

Task  analysis  Is  of  course  not  new,  and  Its  origins  may  lie  with 
the  1898  work  of  Frederick  Taylor  at  the  Midvale  Steel  Company.  A  paper 
by  Hays  (In  press)  contains  a  recent  review  of  the  status  of  task  analysis, 
and  another  by  Berry  (1979)  contains  a  succinct  summary  of  the  problem: 

Modeling  of  a  human-machine  system  for  whatever 
purpose,  requires  that  all  significant  events  occurring 
In  the  system  be  described.  Task  analysis,  standard  In 
the  repertoire  of  the  human  factors  engineer.  Is  the 
technique  generally  used  to  describe  the  activities 
performed  by  the  human  components,  or  operators.  Un¬ 
fortunately,  there  Is  no  agreement  on  the  vocabulary  or 
structure  to  be  used  In  making  these  descriptions. 

Within  the  past  23  years,  at  least  a  dozen  task 
classification  schemes,  or  taxonomies,  have  been  pro¬ 
posed.  Even  definition  of  the  term  task  Is  not  uni¬ 
versally  agreed  upon,  and  this  definition  Is  critical 
because  It  strongly  Influences  the  terms,  units  and 
general  flavor  of  the  final  taxonomy  (p.  1). 

The  difficulties  with  task  analysis  are  well-known  to  developers 
of  military  systems.  "Happy  hour"  conversations  often  contain  stories  of 
defective  task  analyses,  but  virtue  alone  Is  not  enough:  during  the  late 
1960s  and  early  1970s  there  was  a  Joint  German-Amer I  can  development  program 
for  a  main  battle  tank.  The  tank  analysis  for  that  system  when  delivered 
was  32-Inches  thick  and  no  one  was  able  to  use  ft  (Brogan  et.  al,  1981, 
p.  262).  Attempts  were  begun  In  the  late  1970s  In  the  Department  of 
Oefense  to  solve  the  problem  of  task  analysis.  As  General  Becton  explained 
the  problem  to  the  Army's  Vice  Chief  of  Staff, 


A  proper  basis  for  both  human  engineering  and  human 
factors  to  pursue  their  goals  Is  a  task  analysis.  This 
Is  an  analysis  of  those  specific  tasks  an  operator  must 
perform  to  operate  the  system.  A  valid  task  analysis 
provides  a  logical  basis  for  human  engineering  design, 
training  program  development,  training  device  require¬ 
ments,  and  other  management  considerations  such  as  SQTs 
and  MOS  prerequisites.  Too  often  In  the  development  of 
Army  equipment  systems,  task  analyses  are  not  done  or  are 
done  Incompletely.  This  Is  a  primarily  because  no 
military  standard  currently  exists  for  task  analysis,  the 
users  of  task  analysis  Information  have  different  re¬ 
quirements,  multiple  formats  are  used,  and  the  task 
analysis  must  be  called  out  as  a  deliverable  data  Item  to 
be  performed  ( p p •  1-2). 

In  General  Becton's  view,  what  was  needed  was  a  military  solution  to  a 
technological  problem. 

An  intrepid  group  of  military  and  civilian  trainers,  testers  and 
human  factors  specialists  drawn  from  alt  three  armed  services  began 
work  on  the  problem  In  late  1978.  By  June  of  1979  the  group  (officially 
designated  as  the  Test  and  Evaluation  Subgroup  of  the  Department  of 
Defense  Human  Factors  Engineering  Technical  Advisory  Group,  but  more 
commonly  known  as  the  "T&E  SubTAG")  had  reviewed  the  task  analysis  programs 
In  all  three  services,  developed  Its  own  task  taxonomy  (see  Figure  1), 


Mission:  What  the  man-machine  system  Is  supposed  to  accomplish. 

Scenar lo/cond 1 1 Ions :  Categories  of  particular  factors  or  con¬ 

straints  under  which  the  system  will  be  expected  to  operate  and  be 
ma I nta I ned . 

Function:  A  broad  category  of  activity  performed  by  a  man-machine 

system. 

Job:  The  combination  of  all  human  performance  required  for  oper¬ 

ation  and  maintenance  of  one  personnel  position  In  a  system. 

Duty :  A  set  of  operationally-related  tasks  within  a  given  job. 

Task:  A  composite  of  related  activities  (perceptions,  decisions, 

and  responses)  performed  for  an  immediate  purpose,  written  In 
operator/ma I nta I ner  language. 

Subtask :  Activities  (perceptions,  decisions  and  responses)  which 

fulfill  a  portion  of  the  Immediate  purpose  within  a  task. 

Task  Element:  The  smallest  logically  end  reasonably  definable  unit 
of  behavior  required  In  completing  a  task  or  sub-task. 


Figure  1.  Task  Taxonomy  from  Proposed  Military  Standard 


and  outlined  a  proposed  military  standard  or.  task  analysis  (Miles,  1979). 
A  questionnaire  was  subsequently  developed  at  Edwards  AFB,  California  and 
sent  by  name  to  over  a  hundred  pract I t loner s  of  human  factors  and  training 
In  government  and  Industry  to  obtain  their  reactions  to  both  the  proposed 
taxonomy  and  the  Idea  of  having  a  ml  I  I tary  standard  serve  as  arbitrament  In 
this  area.  To  the  utter  astonishment  of  the  subTAG,  more  than  80f  of  the 
survey  respondents  agreed  with  the  proposal  (which  may  be  an  Indication 
that  people  other  than  Army  generals  are  tired  of  chaos  In  this  area). 
Some  minor  revisions  were  then  made  to  the  conceptual  scheme,  and  the  draft 
military  standard  was  prepared  (Zavala,  1980). 

The  drafters  of  the  standard  had  two  Innovative  goals.  First,  they 
wanted  to  use  the  same  task  data  base  for  ail  of  the  specialty  programs 
(design,  training,  test  and  evaluation,  manning  and  workload)  which  tradi¬ 
tionally  have  required  task  analysis.  This  was  both  for  purposes  of 
economy  (It's  hard  enough  to  get  a  project  manager  to  buy  one  task 
analysis  --  let  alone  five)  as  well  as  the  promotion  of  coordination  among 
the  various  specialists  concerned  with  aspects  of  personnel  and  training. 
To  accomplish  that  goal,  they  established  two  resevolrs  of  data  —  "task 
Inventory"  which  Is  rigidly  controlled  by  the  task  taxonomy,  and  "sup¬ 
porting  data"  which  Is  everything  else  In  whatever  format  that  may  be 
needed  to  Insure  the  accuracy  or  validity  of  the  tesk  analysis.  Second, 
they  tried  to  reach  a  new  height  of  specificity  and  flexibility  —  the 
former  so  that  a  contractor  would  know  with  precision  In  every  case  what 
the  desired  task  analysis  should  look  like,  and  the  latter  to  give  the 
government  maximum  freedom  In  terms  of  level  of  detail  while  still  pre¬ 
serving  all  of  the  controls  Inherent  In  the  proposed  standard.  This  was 
accomplished  In  two  primary  ways:  (1)  by  requiring  that  every  task  anal¬ 
ysis  Include  two  specific  levels  In  the  task  Inventory  ("Job"  and  "task") 
and  (2)  by  prescribing  output  format  but  not  process.  It  was  reasoned 
that,  with  these  requirements,  both  gross  and  detailed  task  analyses  could 
be  obtained  from  the  same  data  base  for  the  same  system  (the  latter  by 
adding  more  of  the  optional  levels  of  the  taxonomy)  and  that  two  entirely 
different  systems  (e.g.,  a  rifle  and  a  Jet  aircraft)  could  still  use  the 
same  conceptual  model  of  task  analysis.  A  schematic  of  this  model  Is  shown 
|n  Figure  2.  In  this  model  (and  In  the  draft  standard)  both  the  Input  (at 
least  the  task  Inventory  portion)  and  the  output  (shown  as  "Data  Item 
Descriptions"  on  DD  Forms  1664)  are  carefully  prescribed;  the  process 
called  "task  analysis"  Is  not.  Therefore  the  government  planner  may  direct 
that  the  contractor  use  anything  from  a  stubby-pencil  manual  method  to  one 
of  the  sophisticated  ADP-assIsted  methods  such  as  MOAT  (see  Helm  and 
Donnell,  1979)  --  or  even  some  new  technique  Invented  after  the  standard 
was  written. 

Use  of  this  standard  should  be  particularly  helpful  to  testers  of 
military  systems.  Among  the  recommendations  of  Generals  Kerwln  and 
Blanchard  was  "Manpower  and  skill  level  specifications  and  human  perfor¬ 
mance  requirements  must  be  developed,  stated  and  used  to  the  same  degree 
materiel  specifications  have  been  In  the  past"  (Kerwln  and  Blanchard, 
1980,  p.  7).  Means  for  Implementing  this  recommendation  were  proposed 
by  Kaplan  and  Crooks  (1980)  based  on  integrating  the  draft  task  analysis 
standard  with  their  earlier  efforts  on  HRTES.  In  those  projects  where  that 
recommendation  Is  In  fact  Implemented,  objective,  verifiable  human  perfor¬ 
mance  criteria  will  exist  In  requirements  documents  which  can  easily  be 
translated  Into  test  design  plans  and  then  Into  detailed  test  plans. 
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FIGURE  2.  SCHEMATIC  OF  TASK  ANALYSIS. 
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Tho  draft  military  standard  on  task  analysis  was  croatad  to  bring 
both  ordar  and  standardization  to  tha  procass  of  dascrlblng  and  documantlng 
what  tha  humans  In  a  military  systam  ara  raqulrad  to  do  to  maka  It  function 
proparly.  Its  usa  parmlts  tastars  of  military  systams  to  Idantlfy  quickly 
thosa  human  parformanca  criteria  considered  of  primary  Importance  In 
obtaining  tha  forecast  (aval  of  systam  af factlvanass. 
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